Information processing apparatus and recording medium

ABSTRACT

An information processing apparatus provides for continuous reproduction of audio data that has been added to and associated with image data. After a table of data sets recorded on a memory card (for example) is displayed, a data set is selected, e.g., by pressing a display associated with that data set. When an audio recording button is depressed, the sound is collected by a microphone while the button is depressed. The audio data corresponding to the sound is recorded on the memory card as second audio data of the data set when the selected data set already includes audio data. When the data set is reproduced, the image corresponding to the image data of that data set is displayed and the sound corresponding to each of the first and second audio data is output from the speaker in a continuous sequence.

BACKGROUND OF THE INVENTION

[0001] 1. Field of Invention

[0002] The invention relates to an information processing apparatus andrecording medium. More particularly, the invention relates to aninformation processing apparatus and recording medium for storing andmanaging a plurality of types of data including image data and audiodata.

[0003] 2. Description of Related Art

[0004] Imaging apparatus such as electronic cameras record images asdigital data These apparatus in recent years have become very popular.Other electronic equipment that has become popular in recent years withthe advances of semiconductor technology, are electronic notebooks.Electronic notebooks typically manage personal information andschedules. In many instances the electronic notebooks include touchtablets which provide a mechanism for detecting pressure operations(i.e., contact with the touch tablet) by a user. For example, theseoperations may include the recordation of handwriting input by a userinto a digital format.

[0005] In addition to the above electronic equipment, digital videocameras which record sound and images are also becoming popular. Inthese apparatus, audio data is recorded either in conjunction with theimages and/or as separate data before, during or after the images arerecorded. However, if additional sound is recorded after image data isalready recorded, that additional sound is recorded as separate audiodata from the audio data that is already recorded. Thus, when the soundaccompanying the image is played back, it is necessary to select atleast two separate audio data for playback. This causes, in manyinstances, non-continuous sound playback.

SUMMARY OF THE INVENTION

[0006] It is an object of the invention to provide continuous audio dataplayback even when audio data is added to previously recorded audiodata.

[0007] This and other objects are provided by designating a data setassociated with recorded audio data and recorded image data. Playingback continuous sound is then accomplished by successively recordingadded audio data as data for the data set to which the data of the imagebelongs.

[0008] According to an embodiment of the invention, an informationprocessing apparatus includes storage means for storing data sets madeof a plurality of types of data. The plurality of types of data within adata set are correlated to each other. A selection means selects a dataset from the data sets stored in the storage means. The selected dataset includes first audio data. An audio collecting means collects soundand converts it into second audio data. A control means causes thesecond audio data to be stored in the storage means in addition to thefirst audio data correlated with the data set selected by the selectionmeans.

[0009] The invention can be applied to electronic cameras that recordsound in addition to other information such as, for example,photographic images and line drawings (memos). The invention also isapplicable to devices other than electronic cameras.

[0010] According to another embodiment of the invention, an informationprocessing apparatus includes audio collecting means for collectingsound and converting the collected sound into audio data. For example, arecord button, which functions as an operation means, can be operated tocollect the sound and create the audio data. A storage means stores thecollected audio data. A selection means selects first audio data storedin the storage means. A control means causes second audio data collectedby the audio collecting means to be stored in the storage means inaddition to the first audio data selected by the selection means as dataof a single data set.

[0011] The second audio data is stored correlated with the first audiodata when the first audio data has been selected by the selection means.When the first audio data has not been selected by the selection means,the control means causes the second audio data to be stored in thestorage means without the first audio data.

[0012] A recording medium can be provided that stores acomputer-readable control program that causes the information processingapparatus to function as described above.

[0013] These and other aspects and salient features of the inventionwill be described in or apparent from the following detailed descriptionof preferred embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The invention will be described with reference to the figures inwhich like reference numerals designate like elements and wherein:

[0015]FIG. 1 is a front perspective view of an embodiment of anelectronic camera according to the invention;

[0016]FIG. 2 is a rear perspective view of the FIG. 1 electronic camerawith an LCD cover open;

[0017]FIG. 3 is similar to FIG. 2, but with the LCD cover closed;

[0018]FIG. 4 shows an internal portion of the electronic camera of FIG.1;

[0019] FIGS. 5(A)-5(C) are side views of the electronic camera showingdifferent positions of an LCD switch and a power source switch;

[0020]FIG. 6 is a block diagram of the internal electrical components ofthe electronic camera of FIG. 1;

[0021]FIG. 7 is a flow chart showing a method of image recording andaudio recording;

[0022]FIG. 8 shows one manner in which data is recorded on a memorycard;

[0023]FIG. 9 shows an embodiment of a display of a table of data sets;

[0024]FIG. 10 is a flow chart showing a method of adding audio data to arecorded data set;

[0025]FIG. 11 shows another manner in which data is recorded on thememory card;

[0026] FIGS. 12(A)-12(C) show one example of the displays of a table ofdata sets when audio data has been added; and

[0027] FIGS. 13(A)-13(C) show additional displays of a table of datasets when audio data has been added.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

[0028]FIG. 1 shows an embodiment of an electronic camera according tothe invention. As seen in FIG. 1, the electronic camera comprisessurfaces X1, Y1 and Z. Surface X1 faces an object being photographed,whereas surface Y1 is a side surface and surface Z is a top surface ofthe electronic camera 1. The electronic camera 1 further comprises aviewfinder 2 and a shooting lens 3. The viewfinder 2 confirms thephotographic range of the object being photographed and the shootinglens 3 collects light from the object being photographed. Alight-emitting unit 4 is also provided for emitting light thatilluminates the object being photographed. In preferred embodiments, theshooting lens 3, viewfinder 2 and light emitting unit 4 are proximate tothe top portion of surface X1.

[0029] Surface X1 of electronic camera 1 also includes a red-eyereduction lamp 15, a photometry device 16 and a colorimetry device 17.The red eye reduction lamp 15 emits light prior to the light emittingunit 4 emitting light in order to reduce a red-eye phenomena. Thephotometry device 16 measures an amount of light from the object beingphotographed and the surrounding area and outputs the results to aphotometry circuit 51. The colorimetry device 17 measures a colortemperature of the object being photographed and the surrounding areaand outputs the results to a colorimetry circuit 52. Both the photometrycircuit 51 and the colorimetry circuit 52 are controlled by a CPU 39.

[0030] The surface Y1 includes a continuous shooting mode switch 13 anda release button 10. The continuous shooting mode switch 13 sets acontinuous shooting mode during photography. The continuous shootingmode switch 13 indicates a type of photography action when a releasebutton 10 is completely and continuously depressed. The release button10 can detect a half depressed state and a completely depressed state.The half depressed state is when the release button is depressedapproximately half a full stroke and the completely depressed state iswhen the release button is depressed a full stroke.

[0031] In embodiments, one frame is photographed when the release button10 is completely depressed and the shooting mode switch 13 points to aposition “S” (i.e., single shooting mode). A single frame is shot evenwhen release button 10 is continuously pressed. Eight frames arephotographed per second when the release button 10 is continuously andcompletely depressed and the continuous shooting mode switch 13 pointsto a position “L” (i.e., low speed continuous shooting mode). Thirtyframes are photographed per second when the release button 10 iscontinuously and completely depressed and the continuous shooting modeswitch 13 points to a position “H” (i.e., high speed continuous shootingmode).

[0032]FIG. 2 shows a rear surface X2 of the electronic camera. Theviewfinder 2 and a speaker 5 are provided on the rear surface X2. Thespeaker 5 outputs sound which has been recorded in the electronic camera1. A liquid crystal display (LCD) 6 and operation keys 7 are alsoprovided on the rear surface X2. A touch tablet 6A is provided on theLCD 6 and outputs position information corresponding to a positiondesignated through contact with the touch tablet 6A using, for example,a pen type instruction mechanism 41. The touch tablet 6A is preferablymade from transparent materials such as resin, glass or the like. Inpreferred embodiments, the user observes the images displayed on the LCD6 through the touch tablet 6A.

[0033] The operation keys 7 are actuable via the touch tablet 6A, andinclude (i) a menu key 7A, (ii) an enter key 7B, (iii) a clear key 7C,(iv) a cancel key 7D and (v) a scroll key 7E. Other operation keys alsocan be used with the invention.

[0034] In embodiments, the operation keys 7 detect user contact with thetouch tablet 6A when data is displayed on the underlying LCD 6. Theoperation keys 7 are used in displaying (or otherwise outputting)previously recorded information and in performing photography. Whenactuated, the operation keys 7 output a signal to the CPU 39corresponding to the operation that is being performed.

[0035] Referring particularly to the operation keys 7, when the menu key7A is depressed, a menu screen for selecting various actions isdisplayed on the LCD 6. For example, a display listing the informationthat is recorded or items used in selecting actions for accomplishingvarious settings may be displayed. The enter key 7B reproduces therecorded information (e.g., image data and audio data) which is selectedby the user. The enter key 7 may also be used for performing aphotography action. The clear key 7C erases the selected recordedinformation from a list of recorded information. The cancel key 7Dcancels the recording of the recorded information and the scroll key 7Escrolls up or down the display contents of the LCD 6.

[0036] As shown in FIG. 2, an LCD cover 14 covers the LCD 6 and thetouch tablet 6A. When the LCD cover 14 is moved downward (e.g., an openposition), the LCD 6 and the touch tablet 6A are visible. Also, when theLCD cover 14 is in the open position, a power source switch 11 locatedon side surface Y2 is turned ON by an arm member 14A of the LCD cover14.

[0037] A microphone 8 for collecting audio data and an earphone jack 9for connecting to an earphone are also provided on upper surface Z.

[0038]FIG. 3 shows the electronic camera 1 when the LCD cover 14 ispositioned in the closed position over the LCD 6. FIG. 4 shows theinterior components of the electronic camera 1.

[0039] Referring to FIG. 4, an audio recording button 12 for recordingaudio data is provided. The audio recording button 12 may be positionedat approximately the same height as the release button 10. However, theaudio recording button 12 and the release button 10 may be located atdifferent positions so that when either the release button 10 or theaudio recording button 12 is depressed, the other button is noterroneously depressed. The power source switch 11 turns ON and OFF theelectronic camera 1. A CCD 20, provided at the rear of the shooting lens3, photoelectrically converts a photographed image into electrical(image) signals. An in-viewfinder display device 26 is positioned withinthe field of the viewfinder 2. The in-viewfinder display device 26displays the setting states of various functions of the electroniccamera 1.

[0040] In order to power the electronic camera 1, four cylindricalbatteries 21, for example, are provided below the LCD 6. The electricpower stored in the batteries 21 is supplied to the various cameracomponents when the power is ON. A condenser 22 is provided below theLCD 6 and accumulates the electric charge used when the light emittingunit 4 emits light.

[0041] A circuit board 23 is provided proximate to the LCD 6, andpreferably underneath the LCD 6. A plurality of circuits such as a CPU39 and a DSP 33 (digital signal processor) are provided on the circuitboard 23. A removable memory card 24 is provided between the circuitboard 23, the LCD 6 and the batteries 21. The memory card 24 storesvarious information that is input into the electronic camera 1.

[0042] An LCD switch 25 is located proximate to the power switch 11 andis ON only when the LCD switch 25 is depressed. When the LCD switch 25is ON, an image of the object received by the CCD 20 is displayed on theLCD 6 in real time. Accordingly, the LCD 6 may be used as an electronicviewfinder.

[0043] FIGS. 5(A)-S(C) show side views of the electronic camera 1 withthe LCD cover 14 in various positions. FIG. 5A shows the LCD cover 14 inthe open position and the LCD switch 25 and power switch 11 in an ONstate. The LCD switch 25 and the power switch 11 are in the ON state dueto the arm member 14A moving the switches in a downward position. Whenthe LCD cover 14 is positioned in the closed position over the LCDdisplay 6, the power source switch 11 and the LCD switch 25 are in theOFF state. However, when the LCD cover 14 is in this position, the powersource switch 11 may be switched to the ON state independent of the LCDswitch 25. For example, as seen in FIG. 5(C), the power source switch 11is ON and the LCD switch 25 remains OFF when the LCD cover 14 ispositioned over the LCD 6. Because the power source switch 11 is ON, theelectronic circuits are ON and photography actions such as photographingan object may be possible, even though the LCD 6 is not displayinginformation.

[0044]FIG. 6 shows a block diagram of an embodiment of the internalstructure of the electronic camera 1. The CCD 20 includes plural lightreceiving units corresponding to a predetermined number of pixels. TheCCD 20 photoelectrically converts the light incident on the variouslight receiving units and produces image signals (e.g., electricsignals) corresponding to the predetermined number of pixels. An imageprocessing unit (image processor) 31 is controlled by the CPU 39 andamplifies sampled signals received from the CCD 20 to a preset level.The sampled signals preferably include timing samples of the imagesignals photoelectrically converted by the CCD 20. The CPU 39 alsocompresses digitized audio information and temporarily stores thedigitized information including the compressed audio data in the buffermemory 36 before storing the data on the memory card 24.

[0045] An analog/digital conversion circuit (A/D converter) 32 digitizesthe image signals sampled by the image processing unit 31 and suppliesthe digitized image signals to the DSP (Digital Signal Processor) 33.The DSP 33 controls a data bus connected to the buffer memory 36 and thememory card 24. After temporarily storing the image data supplied fromthe A/D conversion circuit 32 in the memory buffer 36, the DSP 33compresses the image data and stores the compressed image data on thememory card 24. Accordingly, the buffer memory 36 is used as aninput/output buffer for the data on the memory card 24. The DSP 33 alsostores the image data supplied from the A/D conversion circuit 32 in aframe memory 35 and then displays this data on the LCD 6. Similarly,after reading the compressed image data from the memory card 24, DSP 33decompresses the image data, stores the decompressed data in the framememory 35 and displays this data on LCD 6.

[0046] The DSP 33 also supplies a CCD horizontal drive pulse to the CCD20 and controls a CCD drive circuit. (driver) 34 which supplies a CCDvertical drive pulse to the CCD 20. During startup of the electroniccamera 1, the DSP 33 also causes the CCD 20 to adjust an electronicshutter time until an exposure level of the CCD 20 reaches a propervalue.

[0047] An A/D-D/A conversion circuit (converter) 42 converts the analogsignal corresponding to the audio detected by the microphone 8 into adigital signal. The A/DD/A conversion circuit 42 then outputs thedigital signal to the CPU 39. The A/D-D/A conversion circuit 42 alsoconverts the digital audio data supplied from the CPU 39 into an analogaudio signal and outputs the analog audio signal to the speaker 5.

[0048] The photometry circuit 51 performs a predetermined process on theanalog signal that is provided from the photometry device 16. Inembodiments, the photometry circuit 51 converts the analog signal into adigital signal and outputs the digital signal to the CPU 39. The CPU 39then controls a stop driving circuit (driver) 53 to change the aperturediameter of the stop 54 in accordance with the photometry resultsreceived from the photometry device 16.

[0049] The colorimetry circuit 52 performs a predetermined process onthe analog signal that is received from the colorimetry device 17. Inembodiments, the colorimetry circuit 52 converts the analog signal intoa digital signal and outputs the digital signal to the CPU 39. The CPU39 receives the colorimetry results from the colorimetry device 17 andadjusts the white balance in accordance with these results.

[0050] A distance measuring circuit (not shown) converts a distancemeasurement value between the object being photographed and theelectronic camera, as measured by the distance measurement device (alsonot shown), into a digital signal. The distance measurement circuitsupplies the digital signal to the CPU 39 and the CPU 39 then controls alens driving circuit (driver) 30 in accordance with the signal suppliedfrom the distance measurement circuit. This process results in an autofocus action, thus causing the shooting lens 3 to move into focus.

[0051] A timer 45 having a built-in timer circuit outputs datacorresponding to the present time (date and time) to the CPU 39. The CPU39 uses the date and time data supplied from the timer 45 and recordsthe information on the memory card 24 as image data and audio datamanagement information.

[0052] The stop driving circuit 53 sets the aperture diameter of thestop 54 to a predetermined value. The stop 54 is preferably positionedbetween the shooting lens 3 and the CCD 20 and changes the aperture oflight incident on the CCD 20 from the shooting lens 3.

[0053] An interface (I/F) 48 is provided so that data can be transmittedbetween the electronic camera and other apparatus such as, for example,a personal computer.

[0054] A strobe driving circuit (driver) 37 and a red-eye reduction(RER) lamp driving circuit (driver) 38 are also provided. The CPU 39controls the red-eye reduction lamp 15 and light emitting unit 4 to emita suitable amount of light. However, in preferred embodiments, the lightemitting unit 4 does not emit light when the LCD cover 14 is in the openposition so that the photography action may be performed as displayed inthe electronic viewfinder.

[0055] CPU 39 also controls an in-viewfinder display circuit (driver) 40to display various information on the in-viewfinder display device 26.

[0056] The CPU 39 receives position information from the touch tablet 6Aand then processes the information. Specifically, when an area of thetouch tablet 6A overlapping the LCD 6 is selected, the CPU 39successively references the information of various data stored on thememory card 24 by reading the X-Y coordinates of the position pressed onthe touch tablet 6A. By way of example, when the enter key 7B ispressed, the CPU 39 compresses the line drawing data in the buffermemory 36 prior to recording the data on the line drawing data recordingarea of the memory card 24. The line drawing data is also recorded alongwith the input date and time as header information to the line drawingdata. In embodiments, the line drawing does not have to be compressedwhen the amount of line drawing information is small.

[0057] The user also can input line drawing data (memo data) bycontacting the touch tablet 6A with pen 41. The X-Y coordinate(s) wherethe touch tablet 6A is touched is used by the CPU 39 to display acorresponding point (or points—such as a solid or broken line) on theLCD 6. Since the touch tablet 6A is transparent and overlies the LCD 6,it appears as if the user is writing on the LCD 6.

[0058] The line drawing data input into the touch tablet 6A contains alarge amount of components with a high spatial frequency. Because of thelarge amount of components with a high spatial frequency, it ispreferable to use a run length method to compress the data. The runlength method compresses the line drawing and reduces information losswhen decompressing the compressed line drawing data. This isaccomplished by scanning the line drawing screen in a horizontaldirection and encoding each continuous string of data (i.e., points) foreach color (such as black, white, red, blue and the like) and eachcontinuous string of no data (portions with no pen input). The runlength method is a known method used in facsimile machines.

[0059] The JPEG (Joint Photographic Experts Group) method can be used tocompress the shooting image data. Alternatively, other forms ofcompression (or no compression) can be used.

[0060] As will become clearer from the following description, varioustypes of data can be input and stored by the electronic camera. Forexample, shooting image data, line drawing (memo) data and sound datacan be input and stored. Each piece of data is stored with headerinformation. Different pieces of data can be associated (correlated)with each other by correlating the header information of each piece ofdata. Correlation can be achieved, for example, by saving the same time(date and time) data as the header information (this is possible even ifthe various pieces of data are not actually input at the same time).Pieces of data that are correlated to each other are considered to bemembers of the same data set. For example, a photographic image, a linedrawing and a first audio data having correlated (e.g., the same) headerinformation are part of a data set. When that data set is reproduced, itis possible to display the photographic image and the line drawingsimultaneously (superposed) on LCD 6 while the sound corresponding tothe audio data is output by the speaker 5.

[0061] According to the invention, any data set may be selected fromamong plural data sets composed of a plurality of types of correlateddata. Assume that the selected data set includes first audio data. Asecond audio data corresponding to collected audio data may be stored inaddition to the first audio data of the selected data set so that thesound corresponding to the first and second audio data may becontinuously reproduced. Accordingly, it is possible to continuouslyreproduce the sound corresponding to the audio data belonging to thatdata set by designating the data set.

[0062]FIG. 7 is a flow chart showing a method of image recording andsound recording. In step SI the CPU 39 makes a determination as towhether the release button 10 has been completely depressed. If therelease button 10 is not completely depressed, a determination is madein step S2 as to whether the audio recording button 12 is depressed. Ifstep S2 is negative, the process returns to step S1. Thus, the CPU 39waits until either the release button 10 or the audio recording button12 is depressed.

[0063] When the release button 10 is completely depressed, the CPU 39controls the recording of the image in step S3. Specifically, the imageprocessing circuit 31 samples signals corresponding to the image of theobject The sampled signals are converted into digital image data by theA/D conversion circuit 32 and output to the DSP 33. The DSP 33temporarily stores the image data in the buffer memory 36, andcompresses the data, for example, in accordance with the JPEG format.

[0064] In step S4 the CPU 39 determines the number N of data setsrecorded on the memory card 24. In step S5 the CPU 39 records the imagedata compressed by the DSP 33 on the memory card 24 as the image data ofdata set N+1. The image data and management information such as thenumber of the data set and the photography date and the photography timeare recorded on the memory card 24 as header information.

[0065] In step S6 the CPU 39 sets to 1 the value of the counter i usedto count the audio data corresponding to the predetermined data set Instep S7 the CPU resets a time counter. After the image data is recorded,a determination is made in step S8 as to whether the audio recordingbutton 12 is depressed.

[0066] If the audio recording button 12 is not depressed, the value ofthe time counter is referenced in step S9 and a determination is made asto whether a preset time interval has elapsed from when the image datawas recorded. If the preset time interval has elapsed from when theimage data was recorded, the process returns to step S1 and the CPU 39waits until either the release button 10 or the audio recording button12 is depressed. If the preset time interval has not elapsed from whenthe image data was recorded, the process returns to step S7.

[0067] If the audio recording button 12 is depressed at step S8, theprocess moves to step S10 where an audio recording process is performed.In the audio recording process, the audio signal collected by themicrophone 8 while the audio recording button 12 is depressed isconverted into digital audio data by the A/D-D/A conversion circuit 42.The digital audio data is then output to the CPU 39.

[0068] In step S11 the CPU 39 compresses the audio data before recordingthe data on the memory card 24 as audio data i of the data set havingthe same number (N+1) as the image data recorded in step S5. The audiodata and management information including the number of the data set andthe number of the audio data is recorded as header information.

[0069] After audio data number i has been recorded on the memory card24, the CPU 39 increments the value of the counter i by 1 in step S12.The process returns to step S7 and the CPU 39 waits for either thepreset time interval to elapse or the audio recording button 12 to bedepressed.

[0070] Revisiting step S2, when it is determined in step S2 that theaudio recording button is depressed, the process moves to step S13 andthe audio recording process is performed. This is the same process asdescribed in step S10.

[0071] In step S14 the CPU 39 finds the number of data sets recorded onthe memory card 24. In step S15 the CPU records the audio data on thememory card 24 as the audio data of data set number (N+1). That is, anew data set is provided. It is to be noted that the audio data andmanagement information including the number of the data set and therecording date and the recording time are recorded on the memory card 24as header information. In step S16 the CPU 39 sets the value of thecounter i used to count the audio data to 2 because audio data wasrecorded in step S15. The process then moves to step S7 and the sameprocess from step S7 to step S12, as previously described, is performed.

[0072] By using the above process, audio data input before a preset timehas elapsed from when (i) the image data was recorded, (ii) the audiodata accompanying the image data was recorded, or (iii) independentaudio data was recorded, is recorded on the memory card 24 as audio dataof the data set to which the previous data belongs. That is, audio datainput before a preset time has elapsed from when image data or audiodata was input is stored as a continuous audio sequence.

[0073]FIG. 8 shows an embodiment of various types of data being recordedon the memory card 24 assuming no data sets have been previouslyrecorded (N=0). Image data is input by depressing the release button 10.Input of sound is followed by depressing the audio recording button 12before a preset time interval (e.g., 3 seconds) has elapsed. The imagedata and the audio data corresponding to the input image and sound arerecorded on the memory card 24 as the image data and audio data of dataset 1. The management information of the image data and the audio dataare also recorded in data set number 1.

[0074] After a preset time interval has elapsed from when the audio datais recorded, image data is again input by depressing the release button10. The image data is recorded as the image data of data set 2. After apreset period of time has elapsed from when the image data of data setnumber 2 is recorded, audio data is input by depressing the audiorecording button 12. The input audio data is recorded as the audio dataof data set 3. After a preset time interval has elapsed from when theaudio data of data set 3 is recorded, sound is again input by depressingthe audio recording button 12 and is recorded as the audio data of dataset number 4.

[0075]FIG. 9 shows the LCD 6 having a data set number, recording dateand time, thumbnail image, audio mark and audio time for each collecteddata set. In this example, data set number 1 includes image datacorresponding to an image recorded at 8:30 and audio data correspondingto audio that is three seconds long. Data set number 2 includes imagedata corresponding to an image recorded at 8:32. Data set number 3includes audio data corresponding to sound that is five seconds long andrecorded at 9:25. Data set number 4 includes audio data corresponding tosound that is two seconds long and recorded at 9:27. When line drawingdata is included in a data set, a mark unrepresented in FIG. 9, isdisplayed as one part of the data for that data set.

[0076]FIG. 10 is a flow chart of a process when audio data is added to arecorded data set. In step S21 a user selects a data set (e.g., bytouching the data set number with pen 41) and the CPU 39 receives thesignal corresponding to the pressed operation and reverses the displaycolors of the display of that data set. In step S22 when the audiorecording button is pressed by the user, the A/D-D/A conversion circuit42 receives the audio data corresponding to the sound collected by themicrophone 8. In step S23 the CPU 39 makes a determination as to whetheraudio data is included in the data set selected by the user. When thedetermination is that audio data is not included in that data set, thenumber of the audio data is set to 1 in step S24.

[0077] When it is determined that the audio data is included in the dataset, the process moves to step S25 and the CPU 39 references themanagement information of each audio data item on the memory card 24 tofind the number M of audio data items included in that data set. In stepS26 the process sets the number (M+1). In step S27 the process createsmanagement information such as (i) the number of the audio data, (ii)the number of the selected data and (iii) the date and the time datasupplied from the timer 45. This is performed after the number of theaudio data corresponding to the recorded sound is set. In step S28 theprocess records the audio data on the memory card 24 along with themanagement information.

[0078] By utilizing the above process, audio data may be added to theselected data set. That is, audio data having as one part of themanagement information the number of the selected data set and thenumber of the audio data that is one number larger than the number ofaudio data items previously belonging to that data set may be recordedon the memory card 24.

[0079] By way of example, when the audio recording button 12 isdepressed, sound is collected by the microphone 8. The audio datacorresponding to the collected sound is supplied to the CPU 39. Theaudio data is then compressed and recorded on the memory card 24 asaudio data 2 of data set 1 (FIG. 11). When the recorded time is 5seconds, the value of the audio time and the display of the data setdisplay on the LCD 6 is changed from 3 to 8 (FIGS. 12(A) and 12(B)).That is, the sum of the length of the audio items corresponding to allof the audio data belonging to data set 1 is displayed as the value forthat audio time.

[0080] When the data set number 1 is again selected, and sound that istwo seconds long is recorded, and the audio data corresponding to thatsound is recorded on the memory card 24 as audio data 3 of data set 1(FIG. 11). The value 10 is displayed as the audio time of data set 1(FIG. 12(C)). Note that the display of the recording date and timeremains at 8:30 even if audio data is added (FIG. 12(C)). However, it isalso possible to update this time to the time when the new audio data isadded.

[0081] When the above described data number 2 is added to data setnumber 1 at 9:25, the display of the recording date and time for dataset number 1 can change from that shown in FIG. 13(A) to 9:25 (FIG.13(B)). When the audio data number 3 is added to data set number 1 at9:27, the display of the recorded data and the time for data set 1changes to 9:27 (FIG. 13C)). This provides continuous sound playbackcorresponding to an associated image, regardless of when the sound isrecorded.

[0082] Although the JPEG and run length encoding compression techniqueswere described, other compression techniques (or no compression at all)can be used with the invention.

[0083] Although a touch tablet with input pen were described asstructures through which selections and commands can be input, theinvention is not limited to such structure. For example, the touchtablet can be actuable by the user's finger. Additionally, selectionsand commands can be input without using a touch tablet. For example, acursor can be moved (e.g., via a mouse) and selections or commands canbe made by clicking.

[0084] The invention is not limited to implementation by a programmedgeneral purpose computer as shown in the preferred embodiment. Forexample, the invention can be implemented using one or more specialpurpose integrated circuit(s) (e.g., ASIC). It will be appreciated bythose skilled in the art that the invention can also be implementedusing one or more dedicated or programmable integrated or otherelectronic circuits or devices (e.g., hardwired electronic or logiccircuits such as discrete element circuits, or programmable logicdevices such as PLDs, PLAs, PALs or the like). In general, any device orassembly of devices on which a finite state machine capable ofimplementing the flow charts shown in FIGS. 7 and 10 can be used.

[0085] While this invention has been described in conjunction withspecific embodiments thereof, it is evident that many alternatives,modifications and variations will be apparent to those skilled in theart. Accordingly, the preferred embodiments of the invention set forthherein are intended to be illustrative, not limiting. Various changesmay be made without departing from the spirit and scope of the inventionas defined in the following claims.

What is claimed is:
 1. An information processing apparatus, comprising:storage means for storing data sets having plural types of correlateddata therein; selection means for selecting a data set from the datasets stored in said storage means; audio collecting means for collectingsound and converting said sound into audio data; and control means forstoring second audio data collected and converted by the audiocollection means in said storage means, said control means storing saidsecond audio data correlated to first audio data of the data setselected by said selection means.
 2. The information processingapparatus of claim 1, wherein said data sets include at least one of animage data, an audio data and a line drawing data.
 3. The informationprocessing apparatus of claim 2, further comprising: light collectingmeans for collecting light from an object being photographed;photoelectric conversion means for converting the collected light intoan electrical signal; and conversion means for converting said electricsignal into the image data, the image data being stored in said storagemeans.
 4. The information processing apparatus of claim 2, furthercomprising: outputting means for outputting a signal, said signalindicating a pressed position on a pressure detection unit ofpredetermined surface area; and conversion means for converting thesignal output by said outputting means into the line drawing data, theline drawing data being stored in said storage means.
 5. The informationprocessing apparatus of claim 1, further comprising: display means fordisplaying a list of the data sets stored in said storage means; anddisplay control means for computing a total length of recording time ofaudio data belonging to said data sets stored in said storage means andfor displaying the total on said display means.
 6. The informationprocessing apparatus of claim 1, wherein: said control means updates atime information of a data set when the stored second audio data isstored correlated to the data set.
 7. The information processingapparatus of claim 1, wherein said audio data is digital data.
 8. Theinformation processing apparatus of claim 1, wherein when new image datais stored, said selection means selects a data set having the new imagedata for a preset time interval.
 9. An information processing apparatus,comprising: audio collecting means for collecting sound and convertingthe sound into audio data; storage means for storing audio data;selection means for selecting a data set stored in said storage means;and control means for controlling said storage means so that secondaudio data collected and converted by said audio collecting means isstored correlated to first audio data of the data set selected by saidselection means.
 10. The information processing apparatus of claim 9,wherein said control means updates a time information of said firstaudio data in accordance with the second audio data.
 11. The informationprocessing apparatus of claim 9, wherein: said control means causes thesecond audio data to be stored in said storage means without beingcorrelated to said first audio data when said data set is not selectedby said selection means.
 12. The information processing apparatus ofclaim 11, wherein said control means updates a time information of saidfirst audio data in accordance with the second audio data when saidsecond audio data and said first audio data are stored in said storagemeans correlated to each other, and said control means stores timeinformation of said second audio data when the second audio data is notcorrelated to the first audio data.
 13. An information processingapparatus, comprising: a memory that stores data sets having pluraltypes of correlated data therein; a selector that selects a data setfrom the data sets stored in said memory; a microphone that collectssound and converts said sound into audio data; and a controller coupledto the memory, the selector and the microphone, to store second audiodata collected and converted by the microphone in said memory, saidcontroller storing said second audio data correlated to first audio dataof the data set selected by said selector.
 14. The informationprocessing apparatus of claim 13, wherein said data sets include atleast one of an image data, an audio data and a line drawing data. 15.The information processing apparatus of claim 14, further comprising: alens system that collects light from an object being photographed; aphotoelectric converter that receives the light collected by the lenssystem to convert the collected light into the image data, the imagedata being stored in said memory.
 16. The information processingapparatus of claim 14, further comprising: a touch tablet coupled to thecontroller to output a signal indicating a pressed position on a thetouch tablet, the controller converting the signal output by said touchtablet into the line drawing data, the line drawing data being stored insaid memory.
 17. The information processing apparatus of claim 13,further comprising: a display that displays a list of the data setsstored in said memory; and a display controller that computes a totallength of recording time of audio data belonging to said data setsstored in said memory and that displays the total on said display. 18.The information processing apparatus of claim 13, wherein: saidcontroller updates a time information of a data set when the storedsecond audio data is stored correlated to the data set.
 19. Theinformation processing apparatus of claim 13, wherein said audio data isdigital data.
 20. The information processing apparatus of claim 13,wherein when new image data is stored, said selector selects a data sethaving the new image data for a preset time interval.
 21. An informationprocessing apparatus, comprising: a microphone that collects sound andconverts the sound into audio data; a memory that stores audio data; aselector that selects a data set stored in said memory; and a controllercoupled to the microphone, the memory and the selector, to control saidmemory so that second audio data collected and converted by saidmicrophone is stored correlated to first audio data of the data setselected by said selector.
 22. The information processing apparatus ofclaim 21, wherein said controller updates a time information of saidfirst audio data in accordance with the second audio data.
 23. Theinformation processing apparatus of claim 21, wherein: said controllercauses the second audio data to be stored in said memory without beingcorrelated to said first audio data when said data set is not selectedby said selector.
 24. The information processing apparatus of claim 23,wherein said controller updates a time information of said first audiodata in accordance with the second audio data when said second audiodata and said first audio data are stored in said memory correlated toeach other, and said controller stores time information of said secondaudio data when the second audio data is not correlated to the firstaudio data.
 25. A method of processing information, comprising the stepsof: storing data sets having plural types of correlated data therein inmemory; selecting a data set from the data sets stored in said memory;collecting sound and converting said sound into audio data; and storingcollected and converted second audio data in said memory correlated tofirst audio data of the selected data set.
 26. The method of claim 25,wherein said data sets include at least one of an image data, an audiodata and a line drawing data.
 27. The method of claim 26, furthercomprising: collecting light from an object being photographed; andconverting the collected light into the image data, the image data beingstored in said memory.
 28. The method of claim 26, further comprising:outputting a signal indicating a pressed position on a pressuredetection unit of predetermined surface area; and converting the outputsignal into the line drawing data, the line drawing data being stored insaid memory.
 29. The method of claim 25, further comprising: displayinga list of the data sets stored in said memory; and computing anddisplaying a total length of recording time of audio data belonging tosaid data sets stored in said memory.
 30. The method of claim 25,further comprising: updating a time information of a data set when thestored second audio data is stored correlated to the data set.
 31. Themethod of claim 25, wherein said audio data is digital data.
 32. Themethod of claim 25, wherein when new image data is stored, said selecteddata set is, for a preset time interval, the data set having the newimage data.
 33. A method of processing information, comprising the stepsof: collecting sound and converting the sound into audio data; storingaudio data in memory; selecting a data set stored in said memory; andstoring collected and converted second audio data correlated to firstaudio data of the selected data set.
 34. The method of claim 33, furthercomprising updating a time information of said first audio data inaccordance with the second audio data.
 35. The method of claim 33,wherein: the second audio data is stored in said memory without beingcorrelated to said first audio data when said data set is not selected.36. The method of claim 35, further comprising updating a timeinformation of said first audio data in accordance with the second audiodata when said second audio data and said first audio data are stored insaid memory correlated to each other, and storing time information ofsaid second audio data when the second audio data is not correlated tothe first audio data.
 37. A recording medium that stores acomputer-readable control program having instructions that areexecutable by an information processing apparatus to perform the stepsof: storing data sets comprising a plurality of types of correlated datain memory; selecting a data set from the data sets stored in saidstoring step; collecting sound and converting the sound to audio data;and storing second audio data collected and converted in the collectingstep in the memory correlated with first audio data of the data setselected in the selecting step.
 38. A recording medium that stores acomputer-readable control program having instructions that areexecutable by an information processing apparatus to perform the stepsof: collecting sound and converting the sound into audio data; storingaudio data in memory; selecting a data set stored in said memory; andstoring collected and converted second audio data correlated to firstaudio data of the selected data set.